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Abstract. We introduce the framework of path-complete graph Lyapunov functions for ap- 
proximation of the joint spectral radius. The approach is based on the analysis of the underlying 
switched system via inequalities imposed among multiple Lyapunov functions associated to a labeled 
directed graph. Inspired by concepts in automata theory and symbolic dynamics, we define a class of 
graphs called path-complete graphs, and show that any such graph gives rise to a method for proving 
stability of the switched system. This enables us to derive several asymptotically tight hierarchies 
of semidefinite programming relaxations that unify and generalize many existing techniques such as 
common quadratic, common sum of squares, and maximum/minimum-of-quadratics Lyapunov func- 
tions. We compare the quality of approximation obtained by certain classes of path-complete graphs 
including a family of dual graphs and all path-complete graphs with two nodes on an alphabet of two 
matrices. We provide approximation guarantees for several families of path-complete graphs, such 
as the De Bruijn graphs, establishing as a byproduct a constructive converse Lyapunov theorem for 
maximum/minimum-of-quadratics Lyapunov functions. 



Key words, joint spectral radius, stability of switched systems, linear difference inclusions, 
finite automata, Lyapunov methods, semidefinite programming. 



1. Introduction. Given a finite set of square matrices A := {^i, Am}, their 
joint spectral radius p{A) is defined as 

p{A) = lim max \\A„,...A„,A^,f/\ (1.1) 



wfiere the quantity p{A) is independent of the norm used in ( 1.1 1. The joint spectral 
radius ( JSR) is a natural generalization of the spectral radius of a single square matrix 
and it characterizes the maximal growth rate that can be obtained by taking products, 
of arbitrary length, of all possible permutations of Ai, A^,- This concept was 
introduced by Rota and Strang [28 in the early 60s and has since been the subject 
of extensive research within the engineering and the mathematics communities alike. 
Aside from a wealth of fascinating mathematical questions that arise from the JSR, 
the notion emerges in many areas of application such as stability of switched linear 
dynamical systems, Leontief input-output model of the economy with uncertain data, 
computation of the capacity of codes, continuity of wavelet functions, convergence of 
consensus algorithms, trackability of graphs, and many others. See [TO] and references 
therein for a recent survey of the theory and applications of the JSR. 

Motivated by the abundance of applications, there has been much work on efficient 
computation of the joint spectral radius; see e.g. [6], [5], [21], and references therein. 
Unfortunately, the negative results in the literature certainly restrict the horizon of 
possibilities. In |7j, Blondel and Tsitsiklis prove that even when the set A consists of 
only two matrices, the question of testing whether p{A) < 1 is undecidable. They also 
show that unless P=NP, one cannot compute an approximation p oi p that satisfies 
1/5 — p| < ep, in a number of steps polynomial in the bit size of A and the bit size 



*A shorter and preliminary version of this work has been presented in [2] as a conference paper. 
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of e [29] . It is easy to show that the spectral radius of any finite product of length k 
raised to the power of 1/fc gives a lower bound on p [TS]. However, for reasons that 
we explain next, our focus will be on computing upper bounds for p. 

There is an attractive connection between the joint spectral radius and the sta- 
bility properties of an arbitrarily switched linear system; i.e., dynamical systems of 
the form 

Xfc+i = (1.2) 
where ct : Z — > {1, m} is a map from the set of integers to the set of indices. It is 



well-known that p < 1 if and only if system (1.2) is absolutely asymptotically stable 



(AAS), that is, (globally) asymptotically stable for all switching sequences. Moreover, 



it is known |21J that absolute asymptotic stability of (1.2) is equivalent to absolute 
asymptotic stability of the linear difference inclusion 

Xk+i e co^ Xk, (1.3) 

where co^ here denotes the convex hull of the set A. Therefore, any method for 
obtaining upper bounds on the joint spectral radius provides sufficient conditions 



for stability of systems of type (1.2) or (1.3). Conversely, if we can prove absolute 
asymptotic stability of (1.2) or (1.3) for the set A.y ■— {'^Ai, . . . ,'^A„i} for some 



positive scalar 7, then we get an upper bound of ^ on p{A). (This follows from the 
scahng property of the JSR: p{A^) = ^p{A).) One advantage of working with the 
notion of the joint spectral radius is that it gives a way of rigorously quantifying the 



performance guarantee of different techniques for stability analysis of systems (1.2) 



or (1.3) 



Perhaps the most well-established technique for proving stability of switched 
systems is the use of a common (or simultaneous) Lyapunov function. The idea 
here is that if there is a continuous, positive, and homogeneous (Lyapunov) function 
F : M" M that for some 7 > 1 satisfies 

V{-fA,x) <V{x) Vi = l,...,m, Vx e E", (1.4) 



(i.e., V{x) decreases no matter which matrix is applied), then the system in (1.2) (or 
in ( |1.3| )) is AAS. Conversely, it is known that if the system is AAS, then there exists a 
convex common Lyapunov function (in fact a norm); see e.g. |19l p. 24]. However, this 
function is not in general finitely construct able. A popular approach has been to try 
to approximate this function by a class of functions that we can efficiently search for 
using convex optimization and in particular semidefinite programming. Semidefinite 
programs (SDPs) can be solved with arbitrary accuracy in polynomial time and lead 
to efficient computational methods for approximation of the JSR. As an example, if 
we take the Lyapunov function to be quadratic (i.e., V{x) = x'^Px), then the search 
for such a Lyapunov function can be formulated as the following SDP: 

j^AfPA, ^ P Vi = l,...,m. ^^■^> 

The quality of approximation of common quadratic Lyapunov functions is a well- 
studied topic. In particular, it is known [S] that the estimate /5v2 obtained by this 
methocQ satisfies 

-^Pv2{A)<piA)<pv2iA), (1.6) 



^The estimate py2 is the reciprocal of the largest 7 that satisfies \l.5\ and can be found by 
bisection. 
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where n is the dimension of the matrices. This bound is a direct consequence of John's 
elhpsoid theorem and is known to be tight [1]. 

In I24j, the use of sum of squares (SOS) polynomial Lyapunov functions of degree 



2d was proposed as a common Lyapunov function for the switched system in (1.2). 
The search for such a Lyapunov function can again be formulated as a semidefinite 
program. This method does considerably better than a common quadratic Lyapunov 
function in practice and its estimate pysos,2d satisfies the bound 

— PySOS,2d(^) < p{A) < PvSOS.2d{A), (1.7) 

where rj — min{TO, ("^^^^)}. Furthermore, as the degree 2d goes to infinity, the 
estimate px!sos,2d converges to the true value of p [M]. The semidefinite programming 
based methods for approximation of the JSR have been recently generalized and put 
in the framework of conic programming |25j . 

1.1. Contributions and organization. It is natural to ask whether one can 
develop better approximation schemes for the joint spectral radius by using multiple 
Lyapunov functions as opposed to requiring simultaneous contractibility of a single 
Lyapunov function with respect to all the matrices. More concretely, our goal is to 
understand how we can write inequalities among, say, k different Lyapunov functions 



Vi{x), . . . ,Vk{x) that imply absolute asymptotic stability of (1.2) and can be checked 
via semidefinite programming. 

The general idea of using several Lyapunov functions for analysis of switched sys- 
tems is a very natural one and has already appeared in the literature (although to our 
knowledge not in the context of the approximation of the JSR); see e.g. [18], |8], [16], 
[T5] , [12] . Perhaps one of the earliest references is the work on "piecewise quadratic 
Lyapunov functions" in |18j . However, this work is in the different framework of state 
dependent switching, where the dynamics switches depending on which region of the 
space the trajectory is traversing (as opposed to arbitrary switching). In this setting, 
there is a natural way of using several Lyapunov functions: assign one Lyapunov 
function per region and "glue them together" . Closer to our setting, there is a body 
of work in the literature that gives sufficient conditions for existence of piecewise 
Lyapunov functions of the type max{a;"^Pia;, . . . , x'^Pkx}, min{x"^Pia;, . . . , x^Pkx}, 
and conv{a:^Pix, . . . ,x^Pkx}, i.e., the pointwise maximum, the pointwise minimum, 
and the convex envelope of a set of quadratic functions [16], [15], [12], [17]. These 
works are mostly concerned with analysis of linear differential inclusions in continuous 
time, but they have obvious discrete time counterparts. The main drawback of these 
methods is that in their greatest generality, they involve solving bilinear matrix in- 
equalities, which are non-convex and in general NP-hard. One therefore has to turn to 
heuristics, which have no performance guarantees and their computation time quickly 
becomes prohibitive when the dimension of the system increases. Moreover, all of 
these methods solely provide sufficient conditions for stability with no performance 
guarantees. 

There are several unanswered questions that in our view deserve a more thorough 
study: (i) With a focus on conditions that are amenable to convex optimization, what 
are the different ways to write a set of inequalities among k Lyapunov functions that 



imply absolute asymptotic stability of (1.2 1? Can we give a unifying framework that 



includes the previously proposed Lyapunov functions and perhaps also introduces 
new ones? (ii) Among the different sets of inequalities that imply stability, can we 
identify some that are more powerful than some other? (iii) The available methods 
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on piecewise Lyapunov functions solely provide sufficient conditions for stability with 
no guarantee on their performance. Can we give converse theorems that guarantee 
the existence of a feasible solution to our search for a given accuracy? 

The contributions of this paper to these questions are as follows. We propose a 
unifying framework based on a representation of Lyapunov inequalities with labeled 
graphs and by making some connections with basic concepts in automata theory. 
This is done in Section [2j where we define the notion of a path-complete graph (Def- 



2.2 1 and prove that any such graph provides an approximation scheme for 
In Section [3] we give examples of families of path-complete 



mition 

the JSRCrheoremlM 

graphs and show that many of the previously proposed techniques come from par 



ticular classes of simple path-complete graphs (e.g., Corollary 3.4 Corollary 3.5 and 
Remark 3.2). In Section |4j we characterize all the path-complete graphs with two 
nodes for the analysis of the JSR of two matrices. We determine how the approxima- 
tions obtained from all of these graphs compare (Proposition 4.2). In Section [5] we 
study in more depth the approximation properties of a particular pair of "dual" path- 
complete graphs that seem to perform very well in practice. Subsection |5.1| contains 
more general results about duality within path-complete graphs and its connection 
to transposition of matrices (Theorem 5.1). Subsection 5.2 gives an approximation 
guarantee for the graphs studied in Section [5](Theorem 5.4 1, and Subsection 5.3 



tains some numerical examples. In Section ml we prove a converse theorem for the 
method of max-of-quadratics Lyapunov functions (Theorem 6.1) and an approxima- 
tion guarantee for a new class of methods for proving stability of switched systems 
(Theorem 6.2). Finally, our conclusions and some future directions are presented in 
Section [3 

2. Path-complete graphs and the joint spectral radius. In what follows, 
we will think of the set of matrices A ■= {Ai, Am} as a finite alphabet and we 
will often refer to a finite product of matrices from this set as a word. We denote the 
set of all words An . . . A^ of length t hy A*. Contrary to the standard convention 
in automata theory, our convention is to read a word from right to left. This is in 
accordance with the order of matrix multiplication. The set of all finite words is 

denoted by A*; i.e., A* ^ [j A*. 

tei+ 

The basic idea behind our framework is to represent through a graph all the 
possible occurrences of products that can appear in a run of the dynamical system 



in (1.2), and assert via some Lyapunov inequalities that no matter what occurrence 
appears, the product must remain stable. A convenient way of representing these 
Lyapunov inequalities is via a directed labeled graph G[N,E). Each node of this 
graph is associated with a (continuous, positive definite, and homogeneous) Lyapunov 
function Vi : M" K, and each edge is labeled by a finite product of matrices, i.e., by 
a word from the set A* . As illustrated in Figure |2.1[ given two nodes with Lyapunov 
functions Vi (x) and Vj (x) and an edge going from node i to node j labeled with the 
matrix A;, we write the Lyapunov inequality: 



Vj{Aix) < V{x) Wx e K". (2.1) 

The problem that we are interested in is to understand which sets of Lyapunov 
inequalities imply stability of the switched system in (1.2 1. We will answer this 
question based on the corresponding graph. 

For reasons that will become clear shortly, we would like to reduce graphs whose 
edges have arbitrary labels from the set A* to graphs whose edges have labels from 
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A, 




Fig. 2.1. Graphical representation of Lyapunov inequalities. The edge in the graph above 
corresponds to the Lyapunov inequality Vj(Aix) < Vi{x). Here, Ai can be a single matrix from A. 
or a finite product of matrices from A. 



the set A, i.e., labels of length one. This is explained next. 

Definition 2.1. Given a labeled directed graph G{N,E), we define its expanded 
graph G'^{N'^ , E"^) as the outcome of the following procedure. For every edge {i,j) € E 
with label A^. . . . An € A^ , where k > 1, we remove the edge {i,j) and replace it with 
k new edges {sg, s^+i) G E'^ \ ^ '■ 9 {Oi ■ ■ ■ ,k — 1}, where sq = i and Sk = J 
(These new edges go from node i through k ~ 1 newly added nodes Si, . . . , s/c-i ^'^'^ 
then to node j.) We then label the new edges {i, si), . . . , [sq, s^+i), . . . , {sk-i,j) with 
Ail, . . . , Ail, respectively. 




Graph G(XE) Ex|ran(le<l Graph a'(N;E') 



Fig. 2.2. Graph expansion: edges with labels of length more than one are broken into new edges 
with labels of length one. 



An example of a graph and its expansion is given in Figure 2.2 Note that if a 
graph has only labels of length one, then its expanded graph equals itself. The next 
definition is central to our development. 

Definition 2.2. Given a directed graph G{N,E) whose edges are labeled with 
words from the set A* , we say that the graph is path- complete, if for all finite words 
A„^ . . . of any length k (i.e., for all words in A* ), there is a directed path in its 
expanded graph G'^{N'^, E'^) such that the labels on the edges of this path are the labels 

Aai up to AcTfc . 



In Figure 2.3 we present seven path-complete graphs on the alphabet A = 
{Ai,A2}. The fact that these graphs are path-complete is easy to see for graphs 
Hi,H2, Ga, and G4, but perhaps not so obvious for graphs H^, Gi, and G2. One way 
to check if a graph is path-complete is to think of it as a finite automaton by introduc- 
ing an auxiliary start node (state) with free transitions to every node and by making 
all the other nodes be accepting states. Then, there are well-known algorithms (see 
e.g. [m Chap. 4]) that check whether the language accepted by an automaton is A*, 
which is equivalent to the graph being path-complete. Similar algorithms exist in the 
symbolic dynamics literature; see e.g. |22J Chap. 3]. Our interest in path-complete 
graphs stems from Theorem |2.4| below that establishes that any such graph gives a 



It is understood that the node index Sq depends on the original nodes i and j. To keep the 
notation simple we write Sq instead of s^q . 
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method for approximation of the JSR. We introduce one last definition before we state 
this theorem. 
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Graph Gj 
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Fig. 2.3. Examples of path- complete graphs for the alphabet {Ai,A2}. If Lyapunov functions 
satisfying the inequalities associated with any of these graphs are found, then we get an upper bound 
of unity on p(A\, A2) ■ 



Definition 2.3. Let A = he a set of matrices. Given a path- 

complete graph G {N, E) and \N\ functions Vi{x), we say that {Vi{x) \ i = 1, . . . , \NW 
is a graph Lyapunov function (GLF) associated with G {N,E) if 

V,iL{ii,j))x) <V,{x) yxeW\ yii,j)eE, 

where L ((i, j)) G A* is the label associated with edge {i,j) € E going from node i to 
node j . 

Theorem 2.4. Consider a finite set of matrices A — {Ai, . . . , Am}- For a scalar 
7 > 0, let A-y {7^1 J • ■ • J 7^m}- Let G{N, E) be a path-complete graph whose edges 
are labeled with words from A^ . // there exist positive, continuous, and homogeneou^ 
functions Vi{x), one per node of the graph, such that {Vi{x) \ i = l,...,|iV|} is a 
graph Lyapunov function associated with G{N,E), then p{A) < ^. 

Proof. We will first prove the claim for the special case where the edge labels 
of G{N,E) belong to A^ and therefore G{N,E) = G"- {N" , E") . The general case 
will be reduced to this case afterwards. Let d be the degree of homogeneity of the 
Lyapunov functions Vi{x), i.e., Vi{Xx) = \''-Vi{x) for all A G M. (The actual value of d 
is irrelevant.) By positivity, continuity, and homogeneity of Vi{x), there exist scalars 
tti and Pi with < 0;^ < /3i for i = 1, . . . , |A^|, such that 

a^WxW" <V,{x)<PM\ (2.2) 

for all a; G M" and for alH = 1, . . . , |A^|, where ||x|| here denotes the Euclidean norm 



^The requirement of homogeneity can be replaced by radial unboundedness which is implied by 
homogeneity and positivity. However, since the dynamical system in \1.2\ is homogeneous, there is 
no conservatism in asking Vi{x) to be homogeneous. 



Joint Spectral Radius and Path-Complete Graph Lyapunov Functions 



7 



of X. Let 



max 
i,3e{i....,\N\y 



(2.3) 



Now consider an arbitrary product A„^, . . . of length k. Because the graph is path- 
complete, there will be a directed path corresponding to this product that consists 
of k edges, and goes from some node i to some node j. If we write the chain of k 
Lyapunov inequalities associated with these edges (cf. Figure 2.1), then we get 

Vj{-t''A„^...A„^x)<V,{x), 

which by homogeneity of the Lyapunov functions can be rearranged to 



.An 



V,{x) 

We can now bound the spectral norm of Acr^ 

\A(j,_ 



< 



1 



■ A„ 



7 

as follows: 



(2.4) 



\A„ 



.A. 



< max ■ 



■ A^,x\\ 



< 



< 



V/iA,,...A,,x) 
V^x) 



where the last three inequalities follow from (2.2), (2.4), and (2.3) respectively. From 
the definition of the JSR in ( |1.1[ ), after taking the k-th root and the limit k — >■ oo, we 
get that p{A) < ^ and the claim is established. 

Now consider the case where at least one edge of G{N, E) has a label of length 
more than one and hence G'^{N'^ , E'^) ^ G{N,E). We will start with the Lyapunov 
functions Vi{x) assigned to the nodes of G{N,E) and from them we will explicitly 
construct \N^\ Lyapunov functions for the nodes of G'^{N^,E^) that satisfy the Lya- 
punov inequalities associated to the edges in E'^. Once this is done, in view of our 
preceding argument and the fact that the edges of G'^{N'^,E^) have labels of length 
one by definition, the proof will be completed. 

For j G N^, let us denote the new Lyapunov functions by Vj'{x). We give the 
construction for the case where jiV^j = |A^| + 1. The result for the general case follows 
by iterating this simple construction. Let s G N'^\N be the added node in the 
expanded graph, and q,r £ N he such that {s,q) £ and (r, s) £ E'^ with Agq and 
Ars as the corresponding labels respectively. Define 



Vj [x] , 

Vq {A,qX) , 



(2.5) 



if j £N 
if j = s. 

and Am are uniquely defined and 



By construction, r and g, and subsequently, Agq 
hence, {Vj^ (x) | j £ iV^} is well defined. We only need to show that 

Vq {A,qx) < V! {x) 

{ArsX) < Vr (x) . 



(2.6) 
(2.7) 
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Inequality (2.6) follows trivially from (|2.5[). Furthermore, it follows from (2.5 1 that 



(A^sX) — Vq (AgqAj-gX) 
< Vr (x) , 

where the inequality follows from the fact that for z e iV, the functions Vi{x) satisfy 
the Lyapunov inequalities of the edges of G {N, E) . □ 

Remark 2.1. If the matrix Asq is not invertible, the extended function Vj'{x) 
as defined in (2.5^ will only be positive semidefinite. However, since our goal is to 
approximate the JSR, we will never be concerned with invertibility of the matrices in 
A. Indeed, since the JSR is continuous in the entries of the matrices 1191 p. 18], we 
can always perturb the matrices slightly to make them invertible without changing the 
JSR by much. In particular, for any a > 0, there exist Q < e,5 < a such that 

2 _ Asq + SI 
«9 ~ 1 1 ^ 



is invertible and (2.5)— (2.1) are satisfied with Asq — Agq. 

To understand the generality of the framework of "path-complete graph Lyapunov 
funcitons" more clearly, let us revisit the path-complete graphs in Figure |2.3| for the 
study of the case where the set A — {^1,^2} consists of only two matrices. For all 
of these graphs if our choice for the Lyapunov functions V{x) or Vi{x) and V2{x) are 
quadratic functions or sum of squares polynomial functions, then we can formulate 
the well-established semidefinite programs that search for these candidate Lyapunov 
functions. 

Graph Hi, which is clearly the simplest possible one, corresponds to the well- 
known common Lyapunov function approach. Graph H2 is a common Lyapunov 
function applied to all products of length two. This graph also obviously implies 
stability]^ But graph H^ tells us that if we find a Lyapunov function that decreases 
whenever Ai, A\, and A2A1 are applied (but with no requirement when A1A2 is 
applied), then we still get stability. This is a priori not obvious and we believe this 
approach has not appeared in the literature before. Graph H3 is also an example 
that explains why we needed the expansion process. Note that for the unexpanded 
graph, there is no path for any word of the form {AiA2)'^ or of the form A3^^^ , for 
any S N. However, one can check that in the expanded graph of graph iJs, there is 
a path for every finite word, and this in turn allows us to conclude stability from the 
Lyapunov inequalities of graph H^. 

The remaining graphs in Figure |2.3| which all have two nodes and four edges 
have a connection to the method of min-of-quadratics or max-of-quadratics Lyapunov 
functions [IB], [TS], [T2], [T7]. If Lyapunov inequalities associated with any of these 
four graphs are satisfied, then either min{Vi(a;), V2(a;)} or max{yi(x), V2(a;)} or both 
serve as a common Lyapunov function for the switched system. In the next section, 
we assert these facts in a more general setting (Gorollaries|3.4|and|3.5[) and show that 



these graphs in some sense belong to "simplest" families of path-complete graphs. 

3. Duality and examples of families of path-complete graphs. Now that 
we have shown that any path-complete graph yields a method for proving stability of 
switched systems, our next focus is naturally on showing how one can produce graphs 



■^By slight abuse of terminology, we say that a graph implies stability meaning that the associated 
Lyapunov inequalities imply stability. 
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that are path-complete. Before we proceed to some basic constructions of such graphs, 
let us define a notion of duality among graphs which essentially doubles the number 
of path-complete graphs that we can generate. 

Definition 3.1. Given a directed graph G{N,E) whose edges are labeled with 
words in A* , we define its dual graph G' {N, E') to he the graph obtained by reversing 
the direction of the edges of G, and changing the labels A„^, . . . A„-^ of every edge of G 
to its reversed version A^-^ . . . A^-^. . 









( vd J 


Graph G, 


Graph G; 



Fig. 3.1. An example of a pair of dual graphs. 



An example of a pair of dual graphs with labels of length one is given in Figure [371] 
The following theorem relates dual graphs and path-completeness. 

Theorem 3.2. If a graph G{N, E) is path-complete, then its dual graph G'{N, E') 
is also path- complete. 

Proof. Consider an arbitrary finite word Ai^ . . . A^-^ . By definition of path- 
completeness, our task is to show that there exists a path corresponding to this word 
in the expanded graph of the dual graph G' . It is easy to see that the expanded 
graph of the dual graph of G is the same as the dual graph of the expanded graph 
of G; i.e, G'^iN'',E'^) = G"' {N" , E"' ) . Therefore, we show a path for A,, . . . Ai, in 

G"^ . Consider the reversed word Ai. . . . Ai^ . Since G is path-complete, there is a path 
corresponding to this reversed word in G*^. Now if we just trace this path backwards, 
we get exactly a path for the original word Ai^ . . . Ai^ in . This completes the 
proof. □ 

The next proposition offers a very simple construction for obtaining a large family 
of path-complete graphs with labels of length one. 

Proposition 3.3. A graph having any of the two properties below is path- 
complete. 

Property (i): every node has outgoing edges with all the labels in A. 

Property (ii): every node has incoming edges with all the labels in A. 

Proof. If a graph has Property (i), then it is obviously path-complete. If a graph 
has Property (ii), then its dual has Property (i) and therefore by Theorem 3.2 it is 
path-complete. □ 

Examples of path-complete graphs that fall in the category of this proposition 
include graphs Gi, 62,63, and G4 in Figure [23] and all of their dual graphs. By 
combining the previous proposition with Theorem |2.4[ we obtain the following two 
simple corollaries which unify several linear matrix inequalities (LMIs) that have 
been previously proposed in the literature. These corollaries also provide a link to 
min/max-of-quadratics Lyapunov functions. Different special cases of these LMIs have 
appeared in ^16], [15], [12], [17], [20], [9]. Note that the framework of path-complete 
graph Lyapunov functions makes the proof of the fact that these LMIs imply stability 
immediate. 

Corollary 3.4. Consider the set A = {Ai, . . . , Am\ and the associated switched 
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linear system in (1.2) or [1.3). If there exist k positive definite matrices Pj such that 

V(i,fc) e {l,...,m}2, 3je{l,...,m} 

such that -f'^AfPjA, ^ Pk, (3.1) 

for some 7 > 1, then the system is absolutely asymptotically .stable, i.e., p{A) < 1. 
Moreover, the pointwise minimum 

min{a;"'"Pia;, . . . , x'^Pkx} 

of the quadratic functions serves as a common Lyapunov function. 



Proof. The inequalities in (3.1 1 imply that every node of the associated graph has 



outgoing edges labeled with all the different m matrices. Therefore, by Proposition 3.3 
the graph is path-complete, and by Theorem |2.4| this implies absolute asymptotic 
stability. The proof that the pointwise minimum of the quadratics is a common 
Lyapunov function is easy and left to the reader. □ 

Corollary 3.5. Consider the set A — {Ai, . . . , Am} and the associated .switched 
linear system in (1.2) or [1.3). If there exist k positive definite matrices Pj such that 



y{i,3) e {1,...,™}^ {l,...,m} 

such that -f'^AfPjA, ^ Pk, (3.2) 

for some 7 > 1, then the system is absolutely asymptotically .stable, i.e., p{A) < 1. 
Moreover, the pointwise maximum 

max{x"^Pia;, . . . , x'^Pkx} 

of the quadratic functions serves as a common Lyapunov function. 



Proof. The inequalities in (3.2 ) imply that every node of the associated graph has 



incoming edges labeled with all the different m matrices. Therefore, by Proposition 3.3 
the graph is path-complete and the proof of absolute asymptotic stability then follows. 
The proof that the pointwise maximum of the quadratics is a common Lyapunov 
function is again left to the reader. □ 



Remark 3.1. The linear matrix inequalities in 13. l\ ) and (3.2) are (convex) suf- 
ficient conditions for existence of min- of- quadratics or max- of- quadratics Lyapunov 
functions. The converse is not true. The works in I16jj . ilSf . ilS^ . fJTf have addi- 



tional multipliers in (3.1) and (3.2) that make the inequalities non-convex but when 
solved with a heuristic method contain a larger family of min-of-quadratics and max- 
of-quadratics Lyapunov functions. Even if the non-convex inequalities with multipliers 
could be solved exactly, except for special cases where the S-procedure is exact (e.g., 
the case of two quadratic functions), these methods still do not completely characterize 
min-of-quadratics and max-of- quadratics functions. 

Remark 3.2. The work in (20] on "path- dependent quadratic Lyapunov func- 
tions" and the work in (91 on "parameter dependent Lyapunov functions "-when spe- 
cialized to the analysis of arbitrarily .switched linear systems-are special cases of Corol- 
lary \3.4\ and \3.5\ respectively. This observation makes a connection between these 
techniques and min/max-of- quadratics Lyapunov functions which is not established 
in 120], J^. It is also interesting to note that the path- complete graph correspond- 
ing to the LMIs proposed in (20] (see Theorem 9 there) is the well-known De Bruijn 
graph \1^ . We will analyze the bound on the JSR obtained by analysis via this path- 
complete graph in the later sections. 
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The set of path-complete graphs is much broader than the simple family of graphs 
constructed in Proposition |33] Indeed, there are many graphs that are path-complete 
without having outgoing (or incoming) edges with all the labels on every node; see 
e.g. graph i7| in Figure 3.2 This in turn means that there are several interesting and 



unexplored Lyapunov inequalities that we can impose for proving stability of switched 
systems. Below, we give one particular example of such "non-obvious" inequalities 
for the case of switching between two matrices. 




Graph 




Graph 



Fig. 3.2. The path- complete graphs corresponding to Proposition \37i 

Proposition 3.6. Consider the set A = {Ai, A2} and the switched linear system 



in 



1.2) or (1.3). If there exist a positive definite matrix P such that 



-f^A{PAi ^ P, 
j\A2AifP{A2A,) ^ P, 
j^AlA,fP{AlA,) ^ P, 

i'AfPAl < P, 

/or some 7 > 1, then the system is absolutely asymptotically stable, i.e., p{A) < 1. 
Proof. The graph H4 associated with the LMIs above and its expanded version 



are drawn in Figure 3.2 We leave it as an exercise for the reader to show (e.g. by 
induction on the length of the word) that there is path for every finite word in 



Therefore, H4 is path-complete and in view of Theorem 2.4 the claim is established. 
□ 

Remark 3.3. Proposition \3. 6\ can be generalized as follows: If a single Lyapunov 
function decreases with respect to the matrix products 

for some integer k > 1, then p{Ai,A2) < 1. We omit the proof of this generalization 



due to .space limitations. We will later prove (Theorem 6.2) a bound for the quality 
of approximation of path-complete graphs of this type, where a common Lyapunov 
function is required to decrease with respect to products of different lengths. 

When we have so many different ways of imposing conditions for stability, it 
is natural to ask which ones are more powerful. The answer clearly depends on 
the combinatorial structure of the graphs and does not seem to be easy in general. 
Nevertheless, in the next section, we compare the performance of all path-complete 
graphs with two nodes for analysis of switched systems with two matrices. Some 
interesting connections between the bounds obtained from these graphs will arise. 
For example, we will see that the graphs Hi, G3, and 64 always give the same bound 
on the joint spectral radius; i.e., one graph will succeed in proving stability if and 
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only if the other two will. So, there is no point in increasing the number of decision 
variables and the number of constraints and impose G3 or G4 in place of Hi. The 
same is true for the graphs in H3 and G2, which makes graph Ht, preferable to graph 



G2- (See Proposition 4.2 



4. Path-complete graphs with two nodes. In this section, we character- 
ize the set of all path-complete graphs consisting of two nodes, an alphabet set 
A — {^1,^2}, and edge labels of unit length. We will elaborate on the set of all 
admissible topologies arising in this setup and compare the performance — in the sense 
of conservatism of the ensuing analysis — of different path-complete graph topologies. 

Before we proceed, we introduce a notation that will prove to be convenient in 



Subsection 4.2 Given a labeled graph G{N, E) associated with two matrices Ai and 
A2, we denote by G{N, E), the graph obtained by swapping of Ai and A2 in all the 
labels on every edge. 

4.1. The set of path-complete graphs. The next lemma establishes that for 
thorough analysis of the case of two matrices and two nodes, we only need to examine 
graphs with four or fewer edges. 

Lemma 4.1. Let G ({1, 2} , E) be a path-complete graph with labels of length one 
for A = {j4i, A2}. Let {Vi, V2} be a graph Lyapunov function for G. If \E\ > 4, then, 
either 

(i) there exists e € E such that G ({1, 2} , E\e) is a path-complete graph, 
or 

(ii) either Vi or V2 or both are common Lyapunov functions for A. 

Proof. If \E\ > 4, then at least one node has three or more outgoing edges. 
Without loss of generality let node 1 be a node with exactly three outgoing edges 
61162,63, and let L{ei) = L{e2) — Ai. Let 2? (e) denote the destination node of an 
edge e & E.li V (ei) = 2? (62) , then ei (or 62) can be removed without changing 
the output set of words. If V (ei) 7^ V (62) , assume, without loss of generality, that 
2? (ei) = 1 and 2? (£2) — 2. Now, if (63) — Ai, then regardless of its destination node, 
63 can be removed. If L (63) — A2 and V (63) = 1, then Vi is a common Lyapunov 
function for A. The only remaining possibility is that L (63) = A2 and 2? (63) = 2. 
Note that there must be an edge 64 £ E from node 2 to node 1, otherwise either node 
2 would have two self-edges with the same label or V2 would be a common Lyapunov 
function for A. If 2^(64) — A2 then it can be verified that G{{1, 2}, {ei, 62, 63, 64}) is 
path-complete and thus all other edge can be removed. If there is no edge from node 
2 to node 1 with label A2 then L{e4) = Ai and node 2 must have a self-edge G E 
with label ^(es) = A2, otherwise the graph would not be path- complete. In this case, 
it can be verified that 62 can be removed without affecting the output set of words. □ 

One can easily verify that a path-complete graph with two nodes and fewer 
than four edges must necessarily place two self-loops with different labels on one 
node, which necessitates existence of a common Lyapunov function for the underly- 
ing switched system. Since we are interested in exploiting the favorable properties of 
graph Lyapunov functions in approximation of the JSR, we will focus on graphs with 
four edges. 

4.2. Comparison of performance. It can be verified that for path-complete 
graphs with two nodes, four edges, and two matrices, and without multiple self-loops 
on a single node, there are a total of nine distinct graph topologies to consider. Of 
the nine graphs, six have the property that every node has two incoming edg es with 



different labels. These are graphs Gi, G2, G2, G3, G^, and G4 (Figure 2.3). Note 
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that Gi ~ Gi and G4 ~ G4. The duals of these six graphs, i.e., G[, G2, G2, G'^ = 
G3, 6*3 = G3, and G4 = G4 have the property that every node has two outgoing 
edges with different labels. Evidently, G3, G3, and G4 are self-dual graphs, i.e., they 
are isomorphic to their dual graphs. The self-dual graphs are least interesting to us 
since, as we will show, they necessitate existence of a common Lyapunov function for 



A (cf. Proposition 4.2 equation (4.2)). 

Note that all of these graphs perform at least as well as a common Lyapunov func 
tio n be cau se w e can always take Vi (x) — V2 (x). Furthermore, we know from CoroUar 
ies 



3.5 



and 3.4 that if Lyapunov inequalities associated with Gi, G2, G2, G3, G3, and 
G4 are satisfied, then max{Vi (x) , V2 {x)} is a common Lyapunov function, whereas, 
in the case of graphs G'l, G2, G2, G3, G3, and G4, the function min {Vi (x) , V2 (x)} 
would serve as a common Lyapunov function. Clearly, for the self-dual graphs G3, G3, 
and G4 both max {Vi (x) , V2 (a;)} and min {Vi (cc) , V2 (x)} are common Lyapunov 
functions. 

Notation: Given a set of matrices A = {Ai, . . . , A^} , a path-complete graph 
G (iV, E) , and a class of functions V, we denote by pv,G (-4) , the upper bound on the 
JSR of A that can be obtained by numerical optimization of GLFs Vi E V, i E N, 
defined over G. With a slight abuse of notation, we denote by p\> {A) , the upper 
bound that is obtained by using a common Lyapunov function V € V. 

Proposition 4.2. Consider the set A = {^1,^2}, and let Gi, G2, G3, G4, 
and Hj, be the path- complete graphs shown in Figure \27^ Then, the upper hounds on 



the JSR of A obtained via the associated GLFs satisfy the following relations: 

PV,G^ (A) = pv,G[ (A) (4.1) 



pv {A) = pv,Gs {A) - pv,G3 (A) - /5v,G4 {A) (4.2) 

and 

Pv,G2iA) = pv,hAA) , pv,G.AA} = pv,H.AA) (4.3) 

and 

Pv,G', {A) - pv,H^ {A) , pv,G', (A) - Pv,H'^ (A) . (4.4) 



Proof. A proof of (4.1) in more generality is provided in Section [5] (cf. Corollary 
5.3). The proof of (4.2| is based on symmetry arguments. Let {Vi,V2} be a GLF 



associated with G3 (Vi is associated with node 1 and V2 is associated with node 2). 
Then, by symmetry, {V2, Vi} is also a GLF for G3 (where Vi is associated with node 
2 and V2 is associated with node 1). Therefore, letting V = Vi -\- V2, we have that 
{y, V} is a GLF for G3 and thus, V = Vi + V2 is also a common Lyapunov function for 
A, which implies that pv,G3 (A) > pv {A) . The other direction is trivial: If F € V is 
a common Lyapunov function for A, then {Vi, V2 \Vi — V2 — V} is a GLF associated 
with G3, and hence, pv^Gi [A) < pv [A) . Identical argum ents based on symmetry hold 
for G3 and G4. We now prove the left equality in (4.3 1, the proofs for the remaining 
equalities in (4.3) and (4.4) are analogous. The equivalence between G2 and Hj, is 
a special case of the relation between a graph and its reduced model, obtained by 
removing a node without any self-loops, adding a new edge per each pair of incoming 
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and outgoing edges to that node, and then labeling the new edges by taking the 
composition of the labels of the corresponding incoming and outgoing edges in the 
original graph; see [57] i [13 Chap. 5]. Note that is an offspring of G2 in this sense. 
This intuition helps construct a proof. Let {14,^2} be a GLF associated with G2- 
It can be verified that Vi is a Lyapunov function associated with iJs, and therefore, 
Pv,Ha (-4) < pv,G2 (-^) • Similarly, if F S V is a Lyapunov function associated with 
H3, then one can check that {Vi,V2 I Vi (x) = V (x) ,¥2 {x) = V {A2X)} is a GLF 
associated with G2, and hence, pv,H3 (A) > pv,G2 (-4) ■ D 




Fig. 4.1. A diagram describing the relative performance of the path-complete graphs of Fig- 
ure \2.S\ tog ether with their duals and label permutations. The graphs placed in the same circle always 
give the same approximation of the JSR. A graph at the end of an arrow results in an approxima- 
tion of the JSR that is always at least as good as that of the graph at the start of the arrow. When 
there is no directed path between two graphs in this diagram, either graph can outperform the other 
depending on the set of matrices A.. 



Remark 4.1. Proposition ^.2 (equation 4-1) establishes the equivalence of the 
bounds obtained from the pair of dual graphs Gi and G[ . This, however, is not true 
for graphs G2 and G2 as there exist examples for which 



Pv,G2 (-4) 7^ pv,G'^ {A) , 



The diagram in Figure [4~T] summarizes the results of this section. We remark that 
no relations other than the ones given in Figure |4.1| can be established among these 
path-complete graphs. Indeed, whenever there are no relations between two graphs 
in Figure 4.1 we have examples of matrices Ai, A2 (not presented here) for which one 
graph can outperform the other. 

Based on our (incomprehensive) numerical experiments, the graphs Gi and G'l 
seem to statistically perform better than all other graphs in Figure |4.1[ For example, 
we ran experiments on a set of 100 random 5x5 matrices {^41,^2} with elements 
uniformly distributed in [—1, 1] to compare the performance of graphs Gi, G2 and G2. 
If in each case we also consider the relabeled matrices (i.e., {yl2,^i}) as our input, 
then, out of the total 200 instances, graph Gi produced strictly better bounds on the 
JSR 58 times, whereas graphs G2 and G2 each produced the best bound of the three 
graphs only 23 times. (The numbers do not add up to 200 due to ties.) In addition to 
this superior performance, the bound pv,Gi ({^11^2}) obtained by analysis via the 
graph Gi is invariant under (i) permutation of the labels Ai and A2 (obvious), and (ii) 
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transposing of Ai and A2 (Corollary 5.3). These are desirable properties which fail 
to hold for G2 and G2 or their duals. Motivated by these observations, we generalize 
Gi and its dual G[ in the next section to the case of m matrices and m Lyapunov 
functions and establish that they have certain appealing properties. We will prove 



(cf. Theorem 5.4) that these graphs always perform better than a common Lyapunov 



function in 2 steps (i.e., the graph H2 in Figure 2.3), whereas, this is not the case for 
G2 and G2 or their duals. 

5. Further analysis of a particular family of path-complete graphs. The 

framework of path-complete graphs provides a multitude of semidefinite programming 
based techniques for the approximation of the JSR whose performance vary with 
computational cost. For instance, as we increase the number of nodes of the graph, 
or the degree of the polynomial Lyapunov functions assigned to the nodes, or the 
number of edges of the graph that instead of labels of length one have labels of higher 
length, we obtain better results but at a higher computational cost. Many of these 
approximation techniques are asymptotically tight, so in theory they can be used to 
achieve any desired accuracy of approximation. For example, 

Px!sos,2d{A) piA) as 2d — 00, 

where V'^'^'^'^'^ denotes the class of sum of squares homogeneous polynomial Lyapunov 



functions of degree 2d. (Recall our notation for bounds from Section 4.2 ) It is 
also true that a common quadratic Lyapunov function for products of higher length 
achieves the true JSR asymptotically [19]; i.ej^ 

\//5v2 (.4*) p{A) as t ^ cx). 

Nevertheless, it is desirable for practical purposes to identify a class of path- 
complete graphs that provide a good tradeoff between quality of approximation and 
computational cost. Towards this objective, we propose the use of m quadratic Lya- 
punov functions assigned to the nodes of the De Bruijn graphj^ of order 1 on m symbols 
for the approximation of the JSR of a set of m matrices. This graph and its dual are 
particular path-complete graphs with m nodes and edges and will be the subject 
of study in this section. If we denote the quadratic Lyapunov functions by PiX, 
then we are proposing the use of linear matrix inequalities 

^ V« = l,...,m, 

j^AfP.A, ^ P, Vj,j-{l,...,m}2 ^^-^^ 

or the set of LMIs 

P, Vi = l,...,TO, 

l^AfPa^ ^ Pj V*,j = {l,...,m}2 ^^-^^ 

for the approximation of the JSR of m matrices. Throughout this section, we denote 



the path-complete graphs associated with (5.1 ) and (5.2) with Gi and G\ respectively. 



^By we denote the class of quadratic homogeneous polynomials. We drop the superscript 
"SOS" because nonnegative quadratic polynomials are always sums of squares. 

^The De Bruijn graph of order fc on m symbols is a labeled directed graph with m*^ nodes and 
mJ'^^ edges whose nodes are indexed by all possible words of length k from the alphabet {1, . . . , m}, 
and whose edges have labels of length one and are obtained by the following simple rule: There is 
an edge labeled with the letter j (or for our purposes the matrix Aj) going from node 11*2 . . . ik—iih 
to node i2i3 ■ ■ ■ ikj, Vii . . . ij; £ {1, . . . , m}'' and Vj £ {1, . . . , m}. 
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(The De Bruijn graph of order 1, by standard convention, is actually the graph G'l.) 
Observe that Gi and G[ are indeed dual graphs as they can be obtained from each 
other by reversing the direction of the edges. For the case m = 2, our notation is 



consistent with the previous section and these graphs are illustrated in Figure 3.1 



Also observe from Corollary 3.4 and Corollary 3.5 that the LMIs in (5.11 give rise 



to max-of-quadratics Lyapunov functions, whereas the LMIs in (5.2 1 lead to min-of 



quadratics Lyapunov functions. We will prove in this section that the approximation 
bound obtained by these LMIs (i.e., the reciprocal of the largest 7 for which the 
LMIs (5.1) or (5.2 1 hold) is always the same and lies within a multiplicative factor 
of -Ji= of the true JSR, where n is the dimension of the matrices. The relation 
between the bound obtained by a pair of dual path-complete graphs has a connection 
to transposition of the matrices in the set A. We explain this next. 

5.1. Duality and invariance under transposition. In [TT], [T^], it is shown 
that absolute asymptotic stability of the linear difference inclusion in (1.3) defined by 
the matrices A — {Ai, . . . , Am} is equivalent to absolute asymptotic stability of ( 1.3 1 
for the transposed matrices A^ ■= {AT_^ . , ^m}. Note that this fact is immediately 
seen from the definition of the JSR in ( 1.1 ), since p{A) = p{A^). It is also well-known 
that 



Pv^{A) ^ Pv^iA'^). 

Indeed, if Px is a common quadratic Lyapunov function for the set A, then it 
is easy to show that P^^x is a common quadratic Lyapunov function for the set 
. However, this nice property is not true for the bound obtained from some other 
techniques. For instance, the next example shows that 



PySOS,i{A) ^ PySOS,i{Ai^)^ 



(5.3) 



i.e., the upper bound obtained by searching for a common quartic SOS polynomial is 
not invariant under transposition. 

Example 5.1. Consider the set of matrices A = {Ai, A2, A3, A4}, with 



We have pi^sos,i{A) — 21.411, but p-^;sosa{A^) = 21.214 (up to three significant 
digits). 

Similarly, the bound obtained by non-convex inequalities proposed in |11| is not 
invariant under transposing the matrices. For such methods, one would have to run 
the numerical optimization twice — once for the set A and once for the set — 
and then pick the better bound of the two. We will show that by contrast, the 



bound obtained from the LMIs in (5.1) and (5.2 1 are invariant under transposing 
the matrices. Before we do that, let us prove a general result which states that for 
path-complete graphs with quadratic Lyapunov functions as nodes, transposing the 
matrices has the same effect as dualizing the graph. 

Theorem 5.1. Let G{N,E) he a path-complete graph, and let G'{N,E') he its 
dual graph. Then, 



Pv^,g{'A^) = Pv^G'(-4). 



(5.4) 
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Proof. For ease of notation, we prove the claim for the case where the edge labels 
of G{N, E) have length one. The proof of the general case is identical. Pick an 
arbitrary edge € E going from node i to node j and labeled with some matrix 
Ai € A. By the application of the Schur complement we have 



P, Ai 



P- 



^ ^ AJP-^A, -< p-\ 



But this already establishes the claim since we see that Pi and Pj satisfy the LMI 
associated with edge G E when the matrix Ai is transposed if and only if P^^ 
and P~^ satisfy the LMI associated with edge G E'. □ 

Corollary 5.2. /5v2_g(-^) = Pv2,g(-^^) and only if Pv^^ai-^) = pv2 q,{A). 

Proof. This is an immediate consequence of the equality in ( |5.4[ ). □ 

It is an interesting question for future research to characterize the path-complete 
graphs for which one has py2 q{A) = p\:2 q[A^). For example, the above corollary 
shows that this is obviously the case for any path-complete graph that is self-dual. 
Let us show next that this is also the case for graphs Gi and G'l despite the fact that 
they are not self-dual. 

Corollary 5.3. For the path- complete graphs Gi and G'l associated with the 



inequalities in (5.1) and {5.2), and for any class of continuous, homogeneous, and 
positive definite functions V, we have 



PV,GiiA) = pv,G[{A). 



(5.5) 



Moreover, if quadratic Lyapunov functions are assigned to the nodes of Gi and G[ , 
then we have 



PV2,Gi(-4) = /5v2^Gi(-4^) = Pv^,G[{A) = pv2,G[{A^)- 



(5.6) 



Proof. The proof of (5.51 is established by observing that the GLFs associated 
with Gi and G'l can be derived from one another via Vi{Aix) = Vi{x). (Note that we 
are relying here on the assumption that the matrices Ai are invertible, which as we 
noted in Remark 1 2.1 
that pv2,Gi(-4) 



is not a limiting assumption.) Since (5.5) in particular implies 
Pv^.G[iA), we get the rest of the equalities in (5.6 1 immediately 



from Corollary |5.2| and this finishes the proof. For concreteness, let us also prove the 
leftmost equality in (5.6) directly. Let Pi, i — 1, . . . ,m, satisfy the LMIs in (5.1) for 
the set of matrices A. Then, the reader can check that 



P, 



1, 



,m. 



satisfy the LMIs in (5.1 ) for the set of matrices A . □ 



5.2. An approximation guarantee. The next theorem gives a bound on the 



Pv^.G[{A), it is enough to prove this 



quality of approximation of the estimate resulting from the LMIs in (5.1) and (5.2) 
Since we have already shown that pv2 Q^(A) 
bound for the LMIs in ( [5T| ). 

Theorem 5.4. Let A be a set of m matrices in M"^" with JSR p{A). Let 
Pv'^,Gi{A) he the hound on the JSR obtained from the LMIs in (5.1). Then, 



--PV^,G^{A) < piA) < Pv^^G^iA). 



(5.7) 
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Proof. The right inequahty is just a consequence of Gi being a path-complete 
graph (Theorem 2.4). To prove the left inequality, consider the set consisting of all 



products of length two. In view of (1.6), a common quadratic Lyapunov function 



for this set satisfies the bound 



It is easy to show that 



See e.g. [19]. Therefore, 



piA') = p'iA). 



--pU-^') < p{A). 



(5.; 



Now suppose for some 7 > 0, x^Qx is a common quadratic Lyapunov function for 
the matrices in A^; i.e., it satisfies 

Q y 

-(\A,A^YQA,Aj ^ Q Vi,j = {l,...,m}2. 
Then, we leave it to the reader to check that 

Pi^Q + AjQAi, i = l,...,m 



satisfy (5.1). Hence, 



pv-.,gM)<pIM^). 



and in view of (5.8 1 the claim is established. □ 



Note that the bound in (5.7) is independent of the number of matrices. Moreover, 
we remark that this bound is tighter, in terms of its dependence on n, than the 
known bounds for p^sos,2d for any finite degre e 2d of the sum of squares polynomials. 
The reader can check that the bound in (1.7) goes asymptotically as 4=. Numerical 



evidence suggests that the performance of bom the bound obtained by sum of squares 



polynomials and the bound obtained by the LMIs in (5.1) and (5.2) is much better 



than the provable bounds in (1.7) and in Theorem 5.4 The problem of improving 
these bounds or establishing their tightness is open. It goes without saying that 
instead of quadratic functions, we can associate sum of squares polynomials to the 
nodes of Gi and obtain a more powerful technique for which we can also prove better 
bounds with the exact same arguments. 

5.3. Numerical examples. In the proof of Thcorem|5.4[ we essentially showed 



that the bound obtained from LMIs in (5.1) is tighter than the bound obtained from 



a common quadratic applied to products of length two. Our first example shows that 



the LMIs in (5.1 ) can in fact do better than a common quadratic applied to products 

{Ai, A2}, with 



of any finite length. 

Example 5.2. Consider the set of matrices A 



Ai = 



1 
1 



A. = 
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This is a benchmark set of matrices that has been studied in ^J/, \24^ , because it 
gives the worst case approximation ratio of a common quadratic Lyapunov function. 
Indeed, it is easy to show that p{A) = 1, but /5y2 (^) = \/2. Moreover, the bound 
obtained by a common quadratic function applied to the set A* is 



which for no finite value of t is exact. On the other hand, we show that the LMIs in 
(5.1) give the exact bound; i.e., py2 Q_^[A) = 1. Due to the simple structure of Ai and 
we can even give an analytical expression for our Lyapunov functions. Given any 
> 0, the LMIs in (5.1) with 7 = 1/ (1 + e) are feasible with 



A 



a 


■ 




' b 0' 





b 


a 



P^ 



for any & > and a > b/2e. 

Example 5.3. Consider the set of randomly generated matrices A = {Ai, A2, A^}, 

with 



-2 -2 -3 



,-42 = 



A lower bound on p{A) is p^A^A-iA^f I ^ = 11.8015. The upper approximations 
for p{A) that we computed for this example are as follows: 



Pv2{A) 

/5ySOS,4 (A) 



12.5683 

11.9575 
11.8097 
11.8015. 



(5.9) 



The bound p^sosA matches the lower bound numerically and is most likely exact for 
this example. This bound is slightly better than pv2 q^. However, a simple calculation 
shows that the semidefinite program resulting in p^sosA has 25 more decision variables 
than the one for p\>2 q^^. Also, the running time of the algorithm leading to p^sos.i 
is noticeably larger than the one leading to pv^.Gi- ^'^ general, when the dimension of 
the matrices is large, it can often be cost-effective to increase the number of the nodes 
of our path- complete graphs but keep the degree of the polynomial Lyapunov functions 
assigned to its nodes relatively low. 

6. Converse Lyapunov theorems and approximation with arbitrary ac- 
curacy. It is well-known that existence of a Lyapunov function which is the pointwise 
maximum of quadratics is not only sufficient but also necessary for absolute asymp- 
totic stability of ( 1.2 ) or ( 1.3 1; see e.g. 23J. This is perhaps an intuitive fact if we recall 



that switched systems of type (1.2 1 and (1.3) always admit a convex Lyapunov func- 
tion. Indeed, if we take "enough" quadratics, the convex and compact unit sublevel 
set of a convex Lyapunov function can be approximated arbitrarily well with sublevel 
sets of max-of-quadratics Lyapunov functions, which are intersections of ellipsoids. 
This of course implies that the bound obtained from max-of-quadratics Lyapunov 
functions is asymptotically tight for the approximation of the JSR. However, this 
converse Lyapunov theorem does not answer two natural questions of importance in 
practice: (i) How many quadratic functions do we need to achieve a desired quality 
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of approximation? (ii) Can we search for these quadratic functions via semidefinite 
programming or do we need to resort to non-convex formulations? Our next theorem 
provides an answer to these questions. 

Theorem 6.1. Let A he a set of m matrices in M"^". Given any positive integer 
I, there exists an explicit path- complete graph G consisting of m}~^ nodes assigned 
to quadratic Lyapunov functions and m' edges with labels of length one such that the 
linear matrix inequalities associated with G imply existence of a max-of- quadratics 
Lyapunov function and the resulting bound obtained from the LMLs satisfies 

4rPv-MA) < p{A) < pv^,g{A)- (6.1) 

Proof. Let us denote the m''~^ quadratic Lyapunov functions by x"'" Pi-^,,,ii_-^x, 
where ii . . . G {1, . . . , m}'~^ is a muhi-index used for ease of reference to our 
Lyapunov functions. We claim that we can let G be the graph dual to the De Bruijn 
graph of order ^ — 1 on m symbols. The LMIs associated to this graph are given by 

Ptii2...ii-2ii-i >- Vii . . e {1, . . . 

4 T p . . A . p . . 

Vzi...z,_ie{l,...,m}'-i, ^^-^^ 
Vj e {1, . . . ,m}. 

The fact that G is path-complete and that the LMIs imply existence of a max-of- 
quadratics Lyapunov function follows from Corollary |3.5| The proof that these LMIs 



satisfy the bound in (6.1) is a straightforward generalization of the proof of Theo- 



rem |5.4[ By the same arguments we have 

^4^(^')<P(^). (6.3) 
V"- 

Suppose x^Qx is a common quadratic Lyapunov function for the matrices in A''; i.e., 
it satisfies 

Q y 

{Ai,...A,^)'^QA,,...A,^ ^ Q yii...ii e {l,...,my. 
Then, it is easy to check thalQ 

-Pili2---il-2il-l ^ Q ^ A^^__^QAi^_-^ 
+ (^l,_2^i,_l) Q(^i,_2^i!-l) + ' ■ ■ 

+ (^11^12 ■ ■ ■ ^'il-2^ii-l) Q{Aij^Ai^ . . . ), 

ii . . e {1, . . . ,m}'"\ 



satisfy (6.2). Hence, 



and in view of (6.3 1 the claim is established. □ 

Remark 6.1. A converse Lyapunov theorem identical to Theorem \ 6.1\ can be 
proven for the min- of- quadratics Lyapunov functions. The only difference is that the 



LMIs in (6.2) would get replaced by the ones corresponding to the dual graph of G. 



^Thc construction of the Lyapunov function here is a special case of a general scheme for con- 
structing Lyapunov functions that are monotonically decreasing from those that decrease only every 
few steps; see 1, p. 58]. 
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Our last theorem establishes approximation bounds for a family of path-complete 
graphs with one single node but several edges labeled with words of different lengths. 
Examples of such path-complete graphs include graph in Figure [273| and graph 
in Figure |3.2| 

Theorem 6.2. Let A be a set of matrices in M"^". Let G{{1} ,E) he a path- 
complete graph, and I be the length of the shortest word in A ^ {L (e) : e G E} . Then 
pyi ,Q (A) provides an estimate of p {A) that satisfies 



Proof. The right inequality is obvious, we prove the left one. Since both pys ,q (A) 
and p are homogeneous in A, we may assume, without loss of generality, that pys ,q (.4) 
1. Suppose for the sake of contradiction that 

p{A) < 1/ 'V^. (6.4) 

We will show that this implies that Pv^,q (A) < 1. Towards this goal, let us first 



prove that p{A) < p^A). Indeed, if we had p{A) > p''{A), then there would exisl|j 
an integer i and a product e A^ such that 

pHA,)>p'iA). (6.5) 

Since we also have Ag- G A^ (for some j > il), it follows that 

pHAa)<p{A). (6.6) 



The inequality in (6.51 together with p{A) < 1 gives 

pHAa)> p'^iA)> p{A). 



But this contradicts (6.6). Hence we have shown 

piA) < p\A). 



Now, by our hypothesis (6.4) above, we have that p{A) < l/ \/n- Therefore, there 



exists e > such that p{{l + e)A) < It then follows from (1.61 that there exists 

a common quadratic Lyapunov function for (l-fe)^. Hence, pv2{{l + e)A) < 1, which 
immediately implies that pv^,^ {A) < 1, a contradiction. □ 



A noteworthy immediate corollary of Theorem 6.2 (obtained by setting A 



Uf=r-^*) following: If p{A) < then there exists a quadratic Lyapunov 

function that decreases simultaneously for all products of lengths r, r -I- 1, . . . , r -I- A;, 
for any desired value of k. Note that this fact is obvious for r = 1, but nonobvious 
for r > 2. 

7. Conclusions and future directions. We introduced the framework of path- 
complete graph Lyapunov functions for the formulation of semidefinite programming 
based algorithms for approximating the joint spectral radius (or equivalently estab- 
lishing absolute asymptotic stability of an arbitrarily switched linear system). We 



*Here, we are appealing to the well-known fact about the JSR of a general set of matrices B: 
p{B) = limsup^_^j3^ maxgggfc pk(B). See e.g. [I9l Chap. 1]. 
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defined the notion of a patfi-complete grapli, which was inspired by concepts in au- 
tomata theory. We showed that every path-complete graph gives rise to a technique 
for the approximation of the JSR. This provided a unifying framework that includes 
many of the previously proposed techniques and also introduces new ones. (In fact, 
all families of LMIs that we are aware of are particular cases of our method.) We 
shall also emphasize that although we focused on switched linear systems because 
of our interest in the JSR, the analysis technique of multiple Lyapunov functions on 
path-complete graphs is clearly valid for switched nonlinear systems as well. 

We compared the quality of the bound obtained from certain classes of path- 
complete graphs, including all path-complete graphs with two nodes on an alphabet 
of two matrices, and also a certain family of dual path-complete graphs. We proposed 
a specific class of such graphs that appear to work particularly well in practice and 
proved that the bound obtained from these graphs is invariant under transposition 
of the matrices and is always within a multiplicative factor of l/y'n from the true 
JSR. Finally, we presented two converse Lyapunov theorems, one for the well-known 
methods of minimum and maximum-of-quadratics Lyapunov functions, and the other 
for a new class of methods that propose the use of a common quadratic Lyapunov 
function for a set of words of possibly different lengths. 

We believe the methodology proposed in this chapter should straightforwardly 
extend to the case of constrained switching by requiring the graphs to have a path 
not for all the words, but only the words allowed by the constraints on the switching. 
A rigorous treatment of this idea is left for future work. 

Another question for future research is to determine the complexity of checking 
path-completeness of a given graph G{N,E). As we explained in Section [2j well- 
known algorithms in automata theory (see e.g. [IH Chap. 4]) can check for path- 
completeness by testing whether the associated finite automaton accepts all finite 
words. When the automata are deterministic (i.e., when all outgoing edges from 
every node have different labels), these algorithms are very efficient and have running 
time of only 0(|A^p). However, the problem of deciding whether a non-deterministic 
finite automaton accepts all finite words is known to be PSPACE-complete [TUl p. 
265]. We are yet to investigate whether the same is true for automata arising from 
path-complete graphs which have a little more structure. Vincent Blondel showed 
that the problem is at least NP-hard (personal communication). Of course, the step 
of checking path-completeness of a graph is done offline and prior to the run of our 
algorithms for approximating the JSR. Therefore, while checking path-completeness 
is in general difficult, the approximation algorithms that we presented indeed run 
in polynomial time since they work with a fixed (a priori chosen) path-complete 
graph. Nevertheless, the question on complexity of checking path-completeness is 
interesting in many other settings, e.g., when deciding whether a given set of Lyapunov 
inequalities imply stability of an arbitrarily switched system. 

Some other interesting questions that can be explored in the future are the follow- 
ing. What are some other classes of path-complete graphs that lead to new techniques 
for proving stability of switched systems? How can we compare the performance of 
different path-complete graphs in a systematic way? Given a set of matrices, a class 
of Lyapunov functions, and a fixed size for the graph, can we efficiently come up with 
the least conservative topology of a path-complete graph? Within the framework that 
we proposed, do all the Lyapunov inequalities that prove stability come from path- 
complete graphs? What are the analogues of the results of this chapter for continuous 
time switched systems? To what extent do the results carry over to the synthesis 
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(controller design) problem for switched systems? These questions and several others 
show potential for much follow-up work on path-complete graph Lyapunov functions. 

REFERENCES 

[1] A. A. Ahmadi. Non-monotonic Lyapunov functions for stability of nonlinear and switched 
systems: theory and computation. Master's Thesis, Massachusetts Institute of Technology, 
June 2008. Available from http : //dspace .mit . edu/handle/1721 . 1/44206. 

[2] A. A. Ahmadi, R. Jungcrs, P. A. Parrilo, and M. Roozbehani. Analysis of the joint spectral 
radius via Lyapunov functions on path-complete graphs. In Hybrid Systems: Computation 
and Control 2011, Lecture Notes in Computer Science. Springer, 2011. 

[3] A. A. Ahmadi and P. A. Parrilo. Non-monotonic Lyapunov functions for stability of discrete 
time nonlinear and switched systems. In Proceedings of the ^7*'' IEEE Conference on 
Decision and Control, 2008. 

[4] T. Ando and M.-H. Shih. Simultaneous contractibility. SIAM Journal on Matrix Analysis and 
Applications, 19:487-498, 1998. 

[5] V. D. Blondel and Y. Nesterov. Computationally efficient approximations of the joint spectral 
radius. SIAM J. Matrix Anal. Appl, 27(l):256-272, 2005. 

[6] V. D. Blondel, Y. Nesterov, and J. Theys. On the accuracy of the ellipsoidal norm approxima- 
tion of the joint spectral radius. Linear Algebra and its Applications, 394:91-107, 2005. 

[7] V. D. Blondel and J. N. Tsitsiklis. The boundedness of all products of a pair of matrices is 
undecidable. Systems and Control Letters, 41:135-140, 2000. 

[8] M. S. Branicky. Multiple Lyapunov functions and other analysis tools for switched and hybrid 
systems. IEEE Transactions on Automatic Control, 43(4): 475-482, 1998. 

[9] J. Daafouz and J. Bernussou. Parameter dependent Lyapunov functions for discrete time sys- 
tems with time varying parametric uncertainties. Systems and Control Letters, 43(5):355- 
,359, 2001. 

[10] M. R. Carey and D. S. Johnson. Computers and Intractability. W. H. Freeman and Co., San 
Francisco, Calif., 1979. 

[11] R. Coebel, T. Hu, and A. R. Tcel. Dual matrix inequalities in stability and performance analysis 

of linear differential/difEercnce inclusions. In Current Trends in Nonlinear Systems and 

Control, pages 103-122. 2006. 
[12] R. Goebcl, A. R. Tecl, T. Hu, and Z. Lin. Conjugate convex Lyapunov functions for dual linear 

differential inclusions. IEEE Transactions on Automatic Control, 51(4):661— 666, 2006. 
[13] J. L. Cross and J. Yellen. Handbook of Graph Theory (Discrete Mathematics and Its Applica- 
tions). CRC Press, 2003. 
[14] J. E. Hopcroft, R. Motwani, and J. D. UUman. Introduction to Automata Theory, Languages, 

and Computation. Addison Wesley, 2001. 
[15] T. Hu and Z. Lin. Absolute stability analysis of discrete-time systems with composite quadratic 

Lyapunov functions. IEEE Transactions on Automatic Control, 50(6):781-797, 2005. 
[16] T. Hu, L. Ma, and Z. Li. On several composite quadratic Lyapunov functions for switched 

systems. In Proceedings of the .^5*'' IEEE Conference on Decision and Control, 2006. 
[17] T. Hu, L. Ma, and Z. Lin. Stabilization of switched systems via composite quadratic functions. 

IEEE Transactions on Automatic Control, 53(11):2571 - 2585, 2008. 
[18] M. Johansson and A. Rantzer. Computation of piecewise quadratic Lyapunov functions for 

hybrid systems. IEEE Transactions on Automatic Control, 43(4):555-559, 1998. 
[19] R. Jungers. The joint spectral radius: theory and applications, volume 385 of Lecture Notes in 

Control and Information Sciences. Springer, 2009. 
[20] J. W. Lee and C. E. DuUerud. Uniform stabilization of discrete-time switched and Markovian 

jump linear systems. Automatica, 42(2):205-218, 2006. 
[21] H. Lin and P. J. Antsaklis. Stability and stabilizability of switched linear systems: a short 

survey of recent results. In Proceedings of IEEE International Symposium on Intelligent 

Control, 2005. 

[22] D. Lind and B. Marcus. An Introduction to Symbolic Dynamics and Coding. Cambridge 
University Press, 1995. 

[23] A. Molchanov and Y. Pyatnitskiy. Criteria of asymptotic stability of differential and difference 
inclusions encountered in control theory. Systems and Control Letters, 13:59—64, 1989. 

[24] P. A. Parrilo and A. Jadbabaie. Approximation of the joint spectral radius using sum of squares. 
Linear Algebra and its Applications, 428(10):2385-2402, 2008. 

[25] V. Y. Protasov, R. M. Jungers, and V. D. Blondel. Joint spectral characteristics of matrices: 
a conic programming approach. SIAM Journal on Matrix Analysis and Applications, 



24 



A. A. Ahmadi, R. Jungers, P. A. Parrilo, and M. Roozbehani 



31(4):2146-2162, 2010. 

[26] M. Roozbehani. Optimization of Lyapunov invariants in analysis and implementation of safety- 
critical software systems. PhD thesis, Massachusetts Institute of Technology, 2008. 

[27] M. Roozbehani, A. Mcgrctski, E. Frazzoli, and E. Fcron. Distributed Lyapunov functions 
in analysis of graph models of software. Springer Lecture Notes in Computer Science, 
4981:443-456, 2008. 

[28] G. C. Rota and W. G. Strang. A note on the joint spectral radius. Indag. Math., 22:379-381, 
1960. 

[29] J. N. Tsitsiklis and V. Blondcl. The Lyapunov exponent and joint spectral radius of pairs of 
matrices arc hard- when not impossible- to compute and to approximate. Mathematics of 
Control, Signals, and Systems, 10:31-40, 1997. 



